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Abstract 

In this short paper, we give an upper bound for the number of 
different basic feasible solutions generated by the simplex method for 
linear programming problems having optimal solutions. The bound is 
polynomial of the number of constraints, the number of variables, and 
the ratio between the minimum and the maximum values of all the 
positive elements of primal basic feasible solutions. When the primal 
problem is nondegenerate, it becomes a bound for the number of iter- 
ations. We show some basic results when it is applied to special linear 
programming problems. The results include strongly polynomiality of 
the simplex method for Markov Decision Problem by Ye [3] and utilize 
its analysis. 

Keywords Simplex method, Linear programming. Iteration bound, 
Strong polynomiality, Basic feasible solutions. 



1 Introduction 

The simplex method for solving linear programming problems (LP) was orig- 
inally developed by Dantzig [Ij. The simplex method works very efficiently 
in practice and it has been widely used for years. In spite of the practical effi- 
ciency of the simplex method, we do not have any good bound for the number 
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of iterations. Klee and Minty Pj showed that the simplex method needs an 
exponential number of iterations for an elaborately designed problem. 

We analyze the primal simplex method with the most negative pivoting 
rule (Dantzig's rule) or the best improvement pivoting rule under the con- 
dition that the primal problem has an optimal solution. We give an upper 
bound for the number of different basic feasible solutions (BFSs) generated 
by the simplex method. The bound is 

n\m-^ log(m^)] , 



where m is the number of constraints, n is the number of variables, 5 and 7 are 
the minimum and the maximum values of all the positive elements of primal 
BFSs, respectively, and \a\ is the smallest integer bigger than a G 3?. When 
the primal problem is nondegenerate, it becomes a bound for the number of 
iterations. Note that the bound depends only on the constraints of LP, but 
not the objective function. 

Our work is motivated by a recent research by Ye [3] . He shows that the 
simplex method is strongly polynomial for the Markov Decision Problem. 
We apply the analysis in [3] to general LPs and obtain the upper bound. 
Our results include his strong polynomiality. 

When we apply our result to an LP where a constraint matrix is totally 
unimodular and a constant vector b of constraints is integral, the number of 
different solutions generated by the simplex method is at most 

n[m||f>||ilog(m||6||i)]. 

The paper is organized as follows. In section 2, we explain basic notions of 
an LP and we briefly review the simplex method. In section 3, analyses of the 
simplex method are conducted to show our results. In section 4, applications 
of our results to special LPs are discussed. 



2 The Simplex Method for LP 

In this paper, we consider the linear programming problem of the standard 
form 

min c^x, 

subject to Ax = b, x > 0, 

where A G 3?*"^", b G 3?*" and c G 3ft" are given data, and x G 3ft" is a variable 
vector. The dual problem of ([T]) is 

max b'^y, 

subject to A^y + s = c, s > 0, 



2 



where y G 3^™" and s G 3?" are variable vectors. 

We assume that rank(74) = m, the primal problem ([1]) has an optimal so- 
lution and an initial BFS is available. Let x* be an optimal basic feasible 
solution of ([T]), {y*,s*) be an optimal solution of ([2]), and z* be the optimal 
value of ([1]) and ([2]). 

Given a set of indices B C {1,2, .. . ,n}, we split the constraint matrix 
A, the objective vector c, and the variable vector x according to B and 
N = {l,2,...,n} - B like 



A= [Ab,An], 





cb 




Xb 


c = 










cn 




Xn 



Define the set of bases 

B = {S C {1, 2, . . . , n}| \B\ = m, det(AB) ^ 0}. 

Then a primal basic feasible solution ioi B E B and = {1, 2, . . . , n} — i? 
is written as 

Xb = Aj^^b > 0, Xn = 0. 

Let 6 and 7 be the minimum and the maximum values of all the positive 
elements of BFSs. Hence for any BFS x and any j G {1,2, ... ,n}, if Xj 7^ 0, 
we have 

S <Xj < 7. (3) 
Note that these values depend only on A and b, but not on c. 

Let 5* G i3 be the basis of the t-th iteration of the simplex method and 
set A^* = {1, 2, . . . , n} — S*. Problem ([T]) can be written as 

min c^tA'lb + {cn* - A'^t{A~])'^CBt)'^XNt, 

subject to XBt = A^lb — A'^lA^tXNt, 

XBt > 0, XATt > 0. 

The coefficient vector c^t = — A'^t{A^l)'^CBt is called a reduced cost 
vector. When c^t > 0, the current solution is optimal. Otherwise we conduct 
a pivot. That is, we choose one nonbasic variable (entering variable) and 
increase the variable until one basic variable (leaving variable) becomes zero. 
Then we exchange the two variables. Several rules for choosing the entering 
variable have been proposed. For example, the most negative rule, the best 
improvement rule, and the minimum index rule are well known. Under the 
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Table 1: Notations 



X* 


an optimal basic feasible solution of ([T]) 




an optimal solution of ([2]) 


z* 


the optimal value of ([T]) 




the t-th iterate of the simplex method 




the basis of x* 




the nonbasis of 


Cm 


the reduced cost vector at t-th iteration 


A* 


- miUjeAT, Cj 


Jmn 


an index chosen by the most negative rule at t-th iteration 



most negative rule, we choose a nonbasic variable whose reduced cost is 
minimum. To put it precisely, we choose an index 

JiiN = argmincj-. 

We set A* = — c,-t . 

J MAT 

In the case of the best improvement rule, we choose an entering variable 
so that the objective value at the next iterate is minimum. We summarize 
the notations in Table [TJ 

3 Analysis of the Simplex Method 

Our analysis is motivated by a recent work by Ye [3], where he shows a 
strongly polynomial result of the simplex method for the Markov Decision 
Problem, a special class of LP. We apply his analysis to general LPs and 
obtain an upper bound for the number of different basic feasible solutions 
generated by the simplex method. Later we confirm that our results include 
his strongly polynomiality. 

In the next lemma, we get a lower bound of the optimal value at each 
iteration of the simplex method. 

Lemma 3.1 Let z* be the optimal value of Problem (QP and x* be the t-th 
iterate generated by the simplex method with the most negative rule. Then 
we have 

z* > c^x* - A*m7. (4) 
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Proof. Let x* be a basic optimal solution of Problem (|T]). Then we have 



where the second inequality follows since x* has at most m positive elements 
and each element is bounded above by 7. Thus we get the inequality ■ 

Next we show a constant reduction of the gap between the objective 
function value and the optimal value at each iteration when an iterate is 
updated. The result is interesting becasuse the reduction rate (1 — ^) does 
not depend on the objective vector c. 

Theorem 3.1 Let and x^^^ be the t-th and {t + l)-th iterates generated by 
the simplex method with the most negative rule. If x^^^ 7^ x*, then we have 

cV+i -z*<{l- — )(cV - z*). (5) 

Proof. Let x** be the entering variable chosen at the t-th iteration. If 
x^t'^ = 0, then we have x^~^^ = x*, a contradiction occurs. Thus x*.t^ 7^ 0, 
and we have x*.t^ > S from Then we have 

■J MAT 



c^x* - c^x*+^ = A*x*.t^ 
> AM 



> ^(c^x'-z*), 

where the last inequality comes from (j4]). The desired inequality readily 
follows from the above inequality. ■ 

Note that under the best improvement pivoting rule, the objective func- 
tion reduces at least as much as that with the most negative rule. Thus the 
next corollary easily follows. 

Corollary 3.1 Let x* and x*+^ be the t-th and {t + l)-th iterates generated 
by the simplex method with the best improvement rule. If x^^^ 7^ x*, then we 
also have 



From Theorem 13.11 and Corollary 13.11 we can easily get an upper bound 
for the number of different BFSs generated by the simplex method. 
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Corollary 3.2 Let x be a second optimal BFS of LP (|7]j, that is, a minimal 
BPS except for optimal BPSs. When we apply the simplex method with the 
most negative rule or the best improvement rule for LP ^ from an initial 
BPS x^ , we encounter at most 



^ c^x^ — z* 
\m-log{^^ -)] 

X — z* 



different BPSs. 



Proof. Let be the t-th iterates generated by the simplex method and let t 
be the number of different BFSs appearing up to this iterate. Then we have 

c^x' -z*<{l- — )*(cV - z*) 
rri'j 

from ([5]) . If t is bigger than or equal to the number in the corollary, we easily 
get 

c^x* - z* < c^x - z* . 

Since x is a second optimal BFS of LP ([T]), x* must be an optimal BFS from 
the inequality above. ■ 

Note that the bound in the corollary above depends on the objective 
function. In the succeeding discussion, we will have another bound which is 
independent of the objective function. 

The next Lemma states that if the current solution is not optimal, there 
is a basic variable which has an upper bound proportional to the gap between 
the objective value and the optimal value. 

Lemma 3.2 Let x* be the t-th iterate generated by the simplex method. If 
X* is not optimal, there exists j G -B* such that Xj > and 

sj>^{c^x'-z*), 
mx-. 

where s* is an optimal slack vector of Then for any k, the k-th iterate 
x^ satisfies 

I. micFx^ — z*) . 
Xi < ^7^^ —x^ 

Proof. Since 



c-^x* — z* ^ 



E 
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there exists j G B which satisfies 



or equivalently, Xj > and 

>^(cV-^*). 
■' mx-. 

3 

Moreover, for any /c, the /c-th iterate satisfies 



c^x'^ -z* = ix^^'^ 



* ^ A; * \ A; * 



which imphes 

^ ; — ^ -^n — r^4- 

s* c^x* - 2;* 

J 



Lemma 3.3 Let be the t-th iterate generated by the simplex method with 
the most negative rule or the best improvement rule. Assume that x* is not 
an optimal solution. Then there exists j G 5* satisfying the following two 
conditions. 

1. xi > 0. 

2. If the simplex method generates \mj log(mj)] different basic feasible 
solutions after t-th iterate, then Xj becomes zero and stays zero. 

Proof. For /c > t + 1, let A; be the number of different basic feasible solutions 
appearing between the t-th and A;-th iterations. Then from Theorem 13.11 and 
Lemma 13.21 there exists j G Bt which satisfies 

X-- < mil —Yx\ < m7(l —V". 

■' my my 

The second inequality follows from Therefore, if A; > m^log(m^), we 
have Xj < 6, which implies Xj=0 from the definition of 6. ■ 

The event described in Lemma 13.31 can occur at most once for each vari- 
able. Thus we get the following result. 
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Theorem 3.2 When we apply the simplex method with the most negative 
rule or the best improvement rule for LP (Q]) having optimal solutions, we 
encounter at most n[m^ log(m^)] different basic feasible solutions. 

Note that the resuh is vahd even if the simplex method fails to find an opti- 
mal solution because of a cycling. 

If the primal problem is nondegenerate, we have x*^^ 7^ x* for all t. This 
observation leads to a bound for the number of iterations of the simplex 
method. 

Corollary 3.3 // the primal problem is nondegenerate, the simplex method 
finds an optimal solution in at most n[mj log(m^)'| iterations. 

4 Applications to Special LPs 

4.1 LP with a Totally Unimodular Matrix 

In this subsection, we consider an LP ([T]) whose constraint matrix A is totally 
unimodular and all the elements of b are integers. Recall that the matrix A is 
totally unimodular if the determinant of every nonsingular square submatrix 
of A is 1 or -1. Then all the elements of any BPS are integers, so 5 > 1. Let 
us bound 7. Let (xb,0) G 3ft™ x 3?""™- be a basic feasible solution of ([T]). 
Then we have xb = A~j^h. Since A is totally unimodular, all the elements of 
A'^ are ±1 or 0. Thus for any j E B we have Xj < \\b\\i, which implies that 
7 < ll^lli. By Theorem 13. 3 [ we obtain the following result. 

Corollary 4.1 Assume that the constraint matrix A of (QP is totally uni- 
modular and the constraint vector b is integral. When we apply the simplex 
method with the most negative rule or the best improvement rule for (QP, we 
encounter at most n[m||6||i log(m||6||i)] different basic feasible solutions. 

4.2 Markov Decision Problem 

The Markov Decision Problem (MDP), where the number of possible actions 
is two, is formulated as 

min cjxi + C2X2, 

subject to (/ - 9Pi)xi + (/ - ^^2)3^2 = e, (6) 

Xi,X2 > 0, 

where / is the mxm identity matrix. Pi and P2 are mxm Markov matrices, 
^ is a discount rate, and e is the vector of all ones. MDP ([6]) has the following 
properties. 
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1. MDP([n]) is nondegenerate. 



2. The minimum value of all the positive elements of BFSs is greater than 
or equal to 1, or equivalently, 6 > 1. 

3. The maximum value of all the positive elements of BFSs is less than or 
equal to j^, or equivalnetly, 7 < j^. 

Therefore we can apply Corollary 13.31 and obtain a similar result to Ye [3] . 

Corollary 4.2 The simplex method for solving MDP ^ finds an optimal 

2 2 

solution in at most n\j^ log iterations, where n = 2m. 
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